Automated Scoring for Elicited Imitation Tests
نویسنده
چکیده
This paper reports on the fi rst stage of a research project which ultimately aims to automatically score performance on an Elicited Imitation (EI) test. In a standard EI test, the second language (L2) learner hears and then imitates sentences of varying diffi culty. As the length or complexity of items increases, learners fi nd it more diffi cult to imitate and the kinds of errors they make reveal the characteristics of their grammatical ability. EI tests have attracted attention in recent years as ways of assessing L2 learners’ productive grammatical ability, but the time it takes to score such tests manually severely limits the applications to which they can be put. If automatic scoring becomes possible, immediate feedback becomes a reality, and the usefulness of the tests greatly increases. The immediate aim of the fi rst stage in this research project is to build a database of audio fi les of Japanese university students recording English elicited imitation test items and performing on elicited imitation tests. This database will then be used in the next stage of the research to see if an open source automatic speech recognition (ASR) tool can be used to reliably score students’ test performance. Elicited Imitation Tests
منابع مشابه
Elicited Imitation for Prediction of OPI Test Scores
Automated testing of spoken language is the subject of much current research. Elicited Imitation (EI), or sentence repetition, is well suited for automated scoring, but does not directly test a broad range of speech communication skills. An Oral Proficiency Interview (OPI) tests a broad range of skills, but is not as well suited for automated scoring. Some have suggested that EI can be used as ...
متن کاملAutomating the scoring of elicited imitation tests
This paper explores the role of machine learning in automating the scoring for one kind of spoken language test: elicited imitation (EI). After sketching the background and rationale for EI testing, we give a brief overview of EI test results that we have collected. To date, the administration and scoring of these tests have been done sequentially and the scoring latency has not been critically...
متن کاملCombining elicited imitation and fluency features for oral proficiency measurement
The automatic grading of oral language tests has been the subject of much research in recent years. Several obstacles lie in the way of achieving this goal. Recent work suggests a testing technique called elicited imitation (EI) that can serve to accurately approximate global oral proficiency. This testing methodology, however, does not incorporate some fundamental aspects of language, such as ...
متن کاملElicited Imitation as an Oral Proficiency Measure with ASR Scoring
This paper discusses development and evaluation of a practical, valid and reliable instrument for evaluating the spoken language abilities of second-language (L2) learners of English. First we sketch the theory and history behind elicited imitation (EI) tests and the renewed interest in them. Then we present how we developed a new test based on various language resources, and administered it to...
متن کاملSemi-quantitative segmental perfusion scoring in myocardial perfusion SPECT: visual vs. automated analysis
Introduction: It is recommended that the physician apply at least a semi-quantitative segmental scoring system in myocardial perfusion SPECT. We aimed to assess the agreement between automated semi-quantitative analysis using QPS (quantitative Perfusion SPECT) software and visual approach for calculation of summed stress score (SSS), summed rest score (SRS) and summed difference score (SDS). ...
متن کامل